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Abstract. In a previous paper it was shown that the Forward Euler 
method applied to differential inclusions where the right-hand side is a 
Lipschitz continuous set-valued function with uniformly bounded, com- 
pact values, converges with rate one. The convergence, which was there 
in the sense of reachable sets, is in this paper strengthened to the sense 
of convergence of solution paths. An improvement of the error constant 
is given for the case when the set-valued function consists of a small 
number of smooth ordinary functions. 
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1. Introduction 

In this paper we extend the convergence result from [4]. The following 
differential inclusion is considered: 

x'(t) G F(x(t)), 
x{0) = xo, 

where xq S M'^, and F is a function from to the compact subsets of W^. 
In [4], it is shown that if F is uniformly bounded in the sense that 



\y\ 



<K, for all ye [j F{x), (1.2) 



and Lipschitz continuous with respect to Hausdorff distance, 

n{F{x),F{y)) <L\x-y\, (1.3) 

then the Forward Euler method converges with rate one. For the definition 
of the Hausdorff distance we need the following notation (as in [4]). We 
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denote by B the closed unit ball in W^. The Minkowski sum of two non- 
empty sets C,D CM.'^ is defined by 

C + D = {c + d \ c e C and d e D}, 

the multiplication by a scalar, A > 0, by 

\C = {Xc\ce C}, 

and the sum of an element c G M'^ and a set C by 

c + C={c}+C. 

The Hausdorff distance is given by 

n{C,D) =mi{X>0 I C C D + XB and D C C + \B}. 

We will denote by |-| the Euclidean norm, when applied to a vector, and the 
Euclidean operator norm, when applied to a matrix. We consider solutions 
X : [0, T] ^ to the differential inclusion (jl.ip in the finite time interval 
[0, T] . A solution is an absolutely continuous function which satisfies (jl.ip 
a.e. For the Forward Euler method we split the interval [0, T] into N parts 
of equal length At = T/N. The Forward Euler scheme is given by 

U+ieU + ^tF{Cn), n = 0,l,...,N-l, 

c 1-4 
Co = a^o- 

The convergence result in [4] concerns the reachable sets 

C„ = {x{nAt) I X : [0,r] ^ R'^ solution to (fLTIl}. 

Dn = {Cn I {Ci}f=0 solution tO ^} . 

It was shown there that under the assumptions in (jl.2p and ()1.3p the fol- 
lowing bound holds: 

^max^W(C„,L>„) < (^Ke^'^{Kd{d+l) + LT) + 2Kd^At. (1.5) 

This was an extension of the previous first order convergence result in [2] in 
the sense that the set-valued function F did not need to be convex. In [3], 
the non-convex case was presented, although in a different form (see [4]), 
but there only half-order convergence was proved. Although the convergence 
of the reachable sets in ()1.5p is what is needed in many situations, e.g. in 
optimal control (see [4]), it is weaker than the convergence of solution paths, 
the type of convergence used in e.g. [2] and [3]. In section [2] we show that 
the first-order convergence result for non-convex differential inclusions can 
be extended so that it gives convergence of solution paths. The proof is 
actually only a minor change of the proof in [4] . Another weakness with the 
convergence result in ()1.5p is that the constant depends quadratically on the 
dimension. In [4] it was shown that this constant can not be expected to be 
smaller than of order y/d in general. In section [2] a partial improvement is 
given for the case where the differential inclusion is a control problem with 
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few control parameters. In section [3] two results which are needed in the 
proof of the theorem involving few control parameters are presented. 

2. The Results 

We introduce the same set- valued maps that was used in [4]. Let and 
ip be functions from into the non-empty compact subsets of W^, defined 
by 

ip{x) = X + AtF{x), 
ip{x) = X + At co{F{x)), 

where co denotes the convex hull. If ^ is a subset of M"^ we define 

ifiA) = y ifix), 

and similarly for the set-valued maps ip and F We will use the following 
result for convex differential inclusions. It is taken from [2], where it is 
formulated in a slightly more general setting than the one presented here. 

Theorem 2.1. Let F be a function from M'^ into the non-empty compact 
convex subsets of W^, which satisfies ()1.3p and (11. 3p . For any solution x : 
[0,T] — > M"^ to (II. ip there exists a solution {rin}n=o (|1.4p such that 

max \x{nAt) - 7?„| < KLTe^'^At. (2.1) 

0<n<A'' 

Moreover, for any solution {r]n}n=o (|1.4p there exists a solution x : 
[0, T] R'^ to ([LID such that holds. 

The convergence of solution paths to non-convex differential inclusions is 
given next. 

Theorem 2.2. Assume that x : [0,T] R"^ solves (1.1). Let F be a 
function from into the non-empty compact subsets ofW^, which satisfies 
(jl.Sp and (II. 3p . Then there exists a solution {in}n=Q (ll.4p . such that 

max \x{nAt) - < K{e^^d{d +l) + 2d + LTe^'^)At. (2.2) 

0<n<A'' 

Proof. Let {r]n}n=o be a solution to the scheme 

r]n+i £ 'ip{r]n), forO<n<iV-l, 

which satisfies (|2.ip . By lemma 2.1 in [4] it follows that the set- valued 
function co(-F(x)) is Lipschitz continuous in the Hausdorff distance with 
the same constant as F{x). Therefore Theorem 12.11 guarantees the existence 
of such a solution {r/n}- 

Let e be any positive number, n an integer such that d < n < N, and 
Cn-d a point in M.'^ such that 

r]n G i^'^iU-d) + eB. 
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Similarly as in the proof of Theorem 3.4 in [4] we have the following inclusion: 

H^^'iL-d) + eB) C i^^^iin-d)) + {KLd{d + l)At2 + e(l + LAt))B 
Therefore, there must exist an in~d+i G ^Hn-d), such that 

G i)\in-d+i) + {KLd{d + l)At^ + 8(1 + LAt))B. 
It follows that there exists a solution {(,n}n=o to 

en+l G ^(Cn), (2.3) 

for 0<n<A^ — d — 1, such that 
where 

e„+i = (1 + LAt)en + + IjAt^, 

£0 = 0. 

By the proof of Theorem 3.5 in [4] it holds that 

£n < Ke^^''/^d{d + I) At < Ke^^d{d + l)At. 

Let us extend the solution up to n = N, by letting {^n}n=N~d+i 
any solution to (|2.3|) for N — d<n<N — 1. For d < n < N we have 

\U-Vn\ < \(n-^n-d\ + \Vn-CnJ < KdAt + KdAt + Ke^^ d{d+l)At. (2.4) 

For < n < d we have 

\in - rin\ < ICn " a^ol + |??n " a^ol < 2KdAt. 

Hence ([23]) holds for all < n < iV. This together with ^Ai) gives ([22]) □ 

Let us now consider the situation where the set- valued function F is given 

by 

F{x) = {nix)}fi„ (2.5) 

and where we have smoothness, in the sense that there exists a constant 

5 > 0, such that 

|/,(x) - niz) - f[{z){x -z)\<S\x- z\\ (2.6) 
for all 1 < i < M and x, z G M'^. By (H^D we have 

\li[x)\<K, for all 1 < i < M and X G M"*. (2.7) 
Let us assume that we also have the following bound on the Jacobians: 

\fi{x)\ < L, for every x £ R"^. (2.8) 
Under these assumptions we have 
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Theorem 2.3. Assume that ([23!) . (pIB]) . (iOl . and ([TH]) hold. Assume 
that M > d + 1, and that x : [0,T] ^ M'^ solves (II. ip . T/ien i/iere exists a 
solution {£,n}n=Q (jl.4p . suc/i t/iat 

^max^|a;(nAt) - < {e^'^{KLT + K{8M - 10)) + 2K(M - l))At 

+ e^^(KL(M - 1)(M - 2) + 2KL ^^~^^'~^^~^^ (1 + LAt)^^^-^ 

^,^^.M(M-1)(2M-1)^^^,_ 



Proof. This proof fohows the same basic hnes as the proof of Theorem | 
Hence we assume that we have a solution {rin}n=o *o scheme 

r]n+i G ip{r]n), for < n < iV - 1, 

which satisfies (|2.ip . Let e be any positive number, n an integer such that 
M — I < n < N, and ^n,-A/+i a point in M*^ such that 

r?„ G co(/^-^(e„-Af+i)) +eS. 
Similarly as in the proof of Theorem 3.4 in [4] we have the following inclusion: 

%b{co{ip^''\U-M+i)) + eB) C %b{coi^^'~\U-M+i))) + e(l + LAt)B. 
By Theorems 13.31 and 13.21 we have 

i;{co{ip^'-\^n-M+i)))+e{l+LAt)B C \J co{^^'-Hx)) 

+ (e(l + LAt) + (8M - 10)KLAt'^ 

+ (2A-L'<^^-'>'-<^^-'>(l + LAt)*" 

3 

+ 2gK2 ^(^-l)(2M-l) ^^^3^^ ^^^^ ^ ^^^^ ^ ^^^^2 ^ At3) B. 
3 

Therefore, there must exist a G '/'(Cn-A/+i)i such that 

77„+i G co(/'-\e„_M+2)) + + LAt) + CiAt^ + CaAt^)^. 
Hence there exists a solution {S,n}n=o ^^^ *° 

G 93(^n), 

Co = 3^0, 

for < n < iV - M, such that 

rjn+M-i G co(v9^^~^(C„)) 

where 

En+i = (1 + -^^At)e„ + CiAt^ + CsAt^ 
£0 = KL{M - 1)(M - 2)At2. 
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From this we have that 

e„ = (1 + LAt)"+ieo + (^i At^ + C2 At^) (l + (1 + LAt) + ••• + (! + LAt)") . 
For < n < iV - M we have (1 + LAt)" < e^'^ and 



1 + (1 + LAt) + ••• + (! + LAt)" < — — — < 



LAt ~ LAt 
Hence 

En < KLe^^{M - 1)(M - 2)At2 + ^(CiAt + C2At2). 

As in the proof of Theorem 12.21 we can extend {^n} up to and have 

LT 

\Cn-nn\ < KLe^^{M-l){M-2)At^ + ^{CiAt + C2Af) + 2K{M-l)At. 



This together with ^(1A\ gives us □ 

3. The fully discrete case 

We present here two results, Theorems 13.21 and 13. 3( that are useful for 
the proof of Theorem 12. 3[ We will use the following well-known result, the 
Caratheodory Theorem: 

Theorem 3.1. The convex hull of an arbitrary subset A ofW^ is given by 

d+l d+l 

co{A) = I ^AjCj I ai £ A,Xi>0,^Xi = lj. 

i=l i=l 

For a proof, see [1]. 

Theorem 3.2. Assume that (p3|) . ^M), ^l\t . and hold, and that 

M >d+l. Then 

co{ip^'{xo)) C U,6^(,„)Co(y.*^-i(x)) + RB, (3.1) 

where 

R = {8M- W)KLAt^ + (2i^L=^ ~ ~ ~ ^\ l + LAt)^^-^ 



+ 5^^^(^^-^)(^^-^))At3. 

3 ^ 



Proof. We start by introducing the notation 

bi = fi{xo), Ai = flixo), for < i < M. 

To begin with, we will make the assumption that the functions fi are given 
by 

f^{x)=bi + A,{x-xo). (3.2) 

Afterwards, we will consider the general case. For simplicity, we will prove 
(j3.ip for the case where M = d+l. The general result follows directly from 
this. We will also assume that xq = 0, to simplify the presentation. 
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Step 1. Every point x in (^'^^^(xo) is given by 

X = xo + At/i,(xo) + At/i2(xi) + • • • + At/,,^^(xrf), (3.3) 

where ij G {1, . . . ,d + 1}, for all 1 < j < d + 1, and xi, X2,.--, are defined 
recursively by 

Xn+i = Xn + At/i„(x„), forn = 0, . . . , d. 
Since we now assume that the functions fi are given by (|3.2p . we have 

Xn+l = Xn + Atbi^ + AMj^Xn- (3.4) 



When we sum the terms in ()3.3p under the consideration of (j3.4p . we see 
that 

r=l l<ki<k2<...<kr<d+l 

Let X be the approximation of x, where all terms of power three or larger in 
At have been dropped, i.e. 

2 

r=l l<fci<fc2<...<A.v<(i+l 

With the bounds on Ai and bi from (j2.7p and (j2.8p . we have that 
\x-x\<Y,('^^^)L""'KAf 

r=3 V / 

= tT.( ) (^^*) - T (1 + + 1)^^* + 2 ^ ) 

r=0 \ ^ / 

= + LAt)'^+i - :^(l + (d + l)LAt + ^^^±^L^At^). 
L L 2 

With a Taylor expansion of the function /(x) = (1 + x)'^"^^ around x = 0, 
we establish that 

(1 + X)^+1 < 1 + (d + 1)X + ^ii±llx2 + '^-^{l + Xf-^X\ 

o 

and hence 

|x - x| < KL'^^{\ + LAtf-'^At^. (3.5) 
Step 2. We now consider the convex combination 

(1 - + (3.6) 

where x-*^ and x^ are two elements in lp'^^^{xq), such that in the expression 
in ()3.3p for x^, none of the indices in equals one, while for x^, of the 
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indices equal one. We will see how well the convex combination in (13. 6p can 
be represented by another convex combination, 

(1 - + >^ (3.7) 

where and both have precisely one index i„ equal to one in the ex- 
pression in (j3.3p . 

Pick any re G {1, 2, . . . , d + 1}. Assume that we define by changing the 
index z„ (denote in = k) in the expression (j3.3p for x^ to one. Then 

x^-x^ = At(6i - bij + At^{{Ai - AiJibi^ +bi^ + --- + hi^_^) 

+ {^in+i H ^ - bij) + higher order terms. (3.8) 

Simiarly, we define x'^ by exchanging all the indices for which in = 1 to 
in = k. Then the first order term in (j3.7p is the same as in (j3.6p . The 
second order term in the difference x^ — x^ in (j3.8p is bounded in magnitude 
by 2KLdAt^ . Since this bound holds independently of which of the indices 
was changed, it follows that the second order term in the difference x"^ — x^ 
is bounded in magnitude by 2N KLd/S.t^ . Hence the difference in the second 
order term between the convex combinations in ()3.6p and in (j3.7p is bounded 
by 

(1 - ^)2KLdAf + ^2NKLdAt^ = (4 - ^)KLdAt^ < AKLdAt^. 

In step 1, we established that the sum of all terms of order higher than or 
equal to three in At for every element in lp'^^^{xq) is bounded as in (j3.5p . 
We thereby have 

1(1 _ 1) (i 1 _ ^^1) + - (x2 - x2) I < AKLdAt^ + KL^^—^{1 + LAt)'^-^At\ 
^ ^ ^ (3.9) 

Step 3. Let z be any element in co((/9'^~'"^(xo)) • By the Caratheodory 
Theorem (Theorem 13. ip . we have that there exists a, G < d + 1 and points 
and constants G if'^^'^{xo) and ai > 0, for I < i < G, such that 

G 



^aix\ (3.10) 



=1 



and X^^i Ui = 1. We can then write 



d+l 



xq + At 7j6j + higher order terms. 



=1 



where 7^ > for 1 < i < d + 1 and H = d + 1. It must hold that 

at least one of the coefficients 7i > 1. For simplicity, let us assume that 
7i > 1. We will now present an algorithm which gives us an approximation 
of z in the form of a convex combination of points in ip'^~^^{xo) which all 
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have one index i„ = 1 in the formula ()3.3p . We also give an error bound of 
this approximation. 

Let I C {1, 2, . . . , G} be the index set of all the points in p.lOp for 
which none of the indices ii in the formula for the points in ip'^~^^{xo) equals 
one. Let J be a set which consists of the weights corresponding to ele- 
ments in /, i.e. i £ I ii and only if Oi £ J. 

If I = 0, we already have what we are aiming for. Let us therefore 
assume that / is nonempty, and for simplicity that i = 1 is one of the 
elements therein. Take one element in {1, 2, . . . , d + 1} \ /, such that the 
corresponding element in the convex combination (I3.10p is of the form 

X* = xq + At{Nbi + •••)+ higher order terms, 

with N > 2. Such an element must exist, since 71 > 1. For simplicity, let 
us assume that is one such element. We may write 

(aix^ + a2X^) = xq + At{kbi + •••)+ higher order terms. 

ai + a2 

One of the two following cases must hold: 

(1) A; > 1. When this is the case we rewrite as follows: 



Qix +a2X = Qix +— ^x + (a2 - px 

= - j^y + ^^') + - j^i^- (3-11) 

Since A: > 1 we have that 02 — ai/{N — 1) is positive. By the result 
from step 2, we have the approximation result in (13. 9p . with some 
points x^ and x^, both being of the form 

xo + At{bi + •••)+ higher order terms. 

Together with (j3.1ip . this implies that 

G G 

aix' = aix^ + ^ _ ^ x^ + (02 - ^ _ ^ )x'^ + ^ a^x* + k, (3.12) 

i=l 1=3 

where 

1^1 < _ — -ai{4.KLdAt^ + KL^^-{l + LAtY-'^At^). (3.13) 
(2) k <1. In this case we rewrite as follows: 
aix^ + a2X^ = {N — l)a2X^ + Q2X^ + (ai — (A^ — 1)q2)x^ 

= A^a2((l - ^)xi + ^x^) + (ai - {N - l)a2)x\ 
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Since A; < 1 we have that ai — {N — 1)02 is nonnegative. Similarly 
as in case (1), we have 
G G 
^ UiX^ = {N- l)a2X^ + a2X^ + {ai - {N - 1)q2)x^ + ^ QiX* + k, (3.14) 

i=l 1=3 

where 

\k\ < Na2{4:KLdAt'^ + KL^^^-^{1 + LAt)'^-^At^). (3.15) 

3 

If case (1) holds we let 

G 

~1 CKl ~2 / 0!l \ 2 7 

z = aix + j^—jx + (a2 - ^ _ + 2_^aiX , 

i=3 

and remove i = 1 from / and ai from J. If case (2) holds we let 

G 

z = {N - l)a2X^ + 02^^ + (ai - {N - l)a2)x^ + ^ aix\ 

i=3 

and replace ai with (N — 1)02 in J. We then iterate the process above with 
z replaced by z, and the new sets I and J. We continue this process until 
the sets I and J are empty, and we have an approximation i of z of the form 

z = aix\ (3.16) 

i 

where every is of the form 

= j;o + At{mbi + •••)+ higher order terms, 

with m an integer greater than or equal to one. We note that the factor 
Na2, appearing in the error estimate in (|3.15p is the same as the weights 
of the new points x^ and in (|3.14p . The same holds also for case (1), 
with (|3.13p and (|3.12p . Since the total weight of the points that have been 
changed can not be larger than one, we have that 

\z-z\< AKLdAt^ + KL'^^—^il + LAt^-^At^. (3.17) 

3 

Step 4- We now approximate the point z in (j3.16p by a point in 93'^ (xq + 
At/i(xo)). Consider any point in the convex combination in (j3.16p . When 
X* is computed by equation ()3.3p we know that at least one of the indices 
must equal one. Let us assume that in = 1. We denote by x* the element in 
(p'^{xo + Ai/i(xo)) we obtain by switching the indices ii and z„ = 1 in the 
expression for x* in (13. 3p . We then have the difference 

x' - X* = AtmA, + ■■■ + ^i„_J(6,„ -bi,)+ Ai,{bi, + • • • + 6,J 

- Ai^{bi^ H h 6i„_i)) + higher order terms. 

We may get a bound for the magnitude of the difference x* — x* by using the 
bounds on \Ai\ and \bi\ from (12. 7p and (12. Sp and the bound on the higher 
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order terms of and in ()3.5p . We get the largest possible difference if 
n = d+l: 

rP - d 

\x' - x'\ < {U - 2)KLAt^ + KL^——{1 + LAtf-'^M^. 

O 

Now let 

z = ajX*. 

i 

Since cii = 1, we therefore have that 

\z-z\< {Ad - 2)KLAt^ + KL^^^{1 + LAt f-^At\ (3.18) 

3 

S'iep 5. We now consider the contribution to the error from the fact 
that we may not have (j3.2p . but instead the functions fi satisfy (j2.6p . De- 
note by P the set co[ip'^~^^{x(j)) when it is computed using (|3.2p . The set 
co((/j'^^"^(xo)) in the general case satisfies the inclusion 

co(/+i(xo)) CP + rB, 

where 



.2d(d + l)(2d + l)^ . 



r = SK^At^ + ASK'^At^ + ■■■ + d^SK^At^ 

6 

An error of size r is made also when 

^xe'fiixo)co{(f'^{x)) 

is approximated using ()3.2p . This, together with ()3.17p . (I3.18p . and M = 
d+ 1 gives dXIl). □ 

Theorem 3.3. Assume that ([23]) . ([221), (pTT]) . and (f2:8|) /loZd. T/ien 

^(co(/^-i(z))) C co(/^(z)) + gj^2 M(M-l)(2M-l) ^^3^^ ^^^^^^ 

Proof. To begin with, let us assume that 

/.(x) = 6i + - z), for 1 < i < M. (3.20) 
We will show that this implies that 

V'(co(vp^^-i(z))) Cco((^^(z)). (3.21) 
Let V be any unit vector in M'^ and consider the function 

M 

(x, ai, . . . , um) ^ V ■ {x + Uifiix)), 

i=l 

over the set 

M 

{x, ai, . . . ,aM ■ X G co{lp^^ ~^ {z)) , ai G M, > 0, = l} . 

i=l 
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The function is continuous, and the set is compact, and hence there is a 
maximizer 

* * * 

X ,ai,...,aA/. 

We note two things: 

(1) Since the function 

M 
i=l 

is hnear, its maximum over co[ip^^^^(z)^ is attained at a point in 

(2) Since the function 

M 

(ai, . . .,aM) ^v-{x* + At'^aifi{x*)) 

i=l 

is hnear, its maximum over 

M 

{ai, . . . , : G IR, > 0, ^ Qi = 1} 

i=l 

is attained at a point where one of the ai'.s are one. 

Since v can be any element in R'^, these facts imply that 

co(V'(co(/^-i(z)))) = co((^^(z)), (3.22) 

which implies (j3.2ip . 

Now let bi = fi{z) and Ai = fl{z). Let us denote by P the set in (j3.22p 
when the functions in (j3.20p are used. By ()2.6p and (|2.7p we have that 

ip{co{ip^^-\z))) cP + rB, (3.23) 

where 

r = SK'^At^ + ASK^At^ + h (Af - ifSK'^At^ 

6 

Similarly, 

P C co(/'^(z)) +r5. (3.24) 
The inclusion (f3T9]) follows by ((3:23]) and (fM]) . □ 
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